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AMENDMENTS TO THE CLAIMS 

This listing of claims replaces all prior versions, and listings, of claims in the application: 
Listing of Claims: 

1 . (Currently Amended) In a computing device, a computer implemented method for 
recognizing natural human input, the method comprising: 

an act of detecting receiving , at a system component, natural input data directed to an 
input field from a plurality of input fields of an executing program, wherein the natural input 
data comprises an input other than textual input, the natural input data entered into the computing 
device by a user of the computing device , each input field having a context associated with a 
corresponding user specific biasing information that is different from user specific biasing 
information of on e or more other input fields ; 

an act of calling a field signature engine to obtain a field signature for the input field; 

d e termining, external to the executing program, the context of the input fi e ld; 

an act of receiving a field signature for the input field from the field signature engine, the 
field signature representing the context of the input field, the field signature having been 
constructed from an analysis of the attributes of the input field; 

an act of using the field signature as a key to query a field mapping database for a factoid 
for the represented context; 

an act of receiving a factoid from the field mapping database, the factoid containing 
contextual rules to more accurately recognize that natural input data; 

an act of using the factoid as a key to query a user bias database for user bias data; 

an act of receiving using bias data that can be used to further refine the recognition of the 
natural input data, within the represented context and in combination with the contextual rules, to 
more accurately recognize that natural data input; 

retrieving corresponding user - specific biasing information for the input field based on th e 
determined context of the input field; 

analyzing the natural input data directed to the input field based on the user specific 

biasing information retrieved for the input field; and 
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an act of submitting the natural input data, the factoid, and the user bias data to a 
recognition engine so that the recognition engine can use the contextual rules contained in the 
factoid and the user bias data to perform context-based recognition of the natural data input; and 

providing an act of receiving a recognition result of the natural input data from the 
recognition engine to the executing program for inclusion in the input field, the recognition result 
biased by the user-specific biasing information within the represented context and comprising at 
least one computer code corresponding to recognition of the natural input . 

2. (Currently Amended) The method of claim 1 wherein the use r specific biasing 
information comprises previously entered user data that is more likely to be a recognition result 
of the natural input data based on the represented context of the input field a factoid including at 
least one validation rule . 

3. (Original) The method of claim 2 wherein the factoid is developed based on 
communicating with the executing program. 

4. (Currently Amended) The method of claim 2 wherein providing receiving the 
recognition result to the executing program includes providing the factoid to a recognition 
engine. 

5. (Currently Amended) The method of claim 1 wherein the use r specific biasing 
information comprises a set of user bias data. 

6. (Currently Amended) The method of claim 5 a further comprising^ 
maintaining the set of user bias data in a user bias databas e, and retrieving the set of user 

bias data from the database by querying the databas e with a key that corresponds to the input 
f iel d 

7. (Original) The method of claim 5 further comprising, harvesting the user bias 
data from at least one data store accessible to the computing device. 
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Claims 8-10. (Cancelled). 

1 1 . (Currently Amended) The method of claim 10 wherein the input field corresponds 
to a window, and wherein generating a field signature includes acquiring window attribute data. 

Claims 12. (Cancelled). 

13. (Original) The method of claim 1 wherein the natural input data comprises 
speech or handwriting data. 

14. (Original) A computer-readable medium having computer-executable 
instructions for performing the method of claim 1 . 
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15. (Currently Amended) In a computing device having an executable program, a A 
computer system comprising: 
one or more processors; 
system memory; and 

one or more computer-readable media having stored thereon computer-executable 
instructions representing the following: 

a human input recognition engine configured to convert natural input data to recognition 
results, wherein the natural input data comprises an input other than textual input, each 
recognition result comprising at least one computer code; 

a field determination mechanism that determines contexts for at least some input fields of 
executable programs as determined contexts; 

at least one field mapping database that maintains rules corresponding to determined 
contexts; 

at least one user bias database that maintains biasing information for a plurality of the 
determined contexts^ and 

an input system configured to: 

1) receive detect natural input data directed to an input field from among a plurality 
of input fields of the executing program, the natural input data entered into the computing device 
by a user of the computing device, each input field having a cont e xt associated with a 
corresponding us e r specific biasing information that is different from user specific biasing 
information of one or more other input fields ; 

2) communicate with call the field determination mechanism to obtain the 
determined context of the input field to which the natural input data is directed; 

3) receive a field signature for the input field from the field determination 
mechanism, the field signature representing the determined context of the input field, the field 
signature having been constructed from an analysis of the attributes of the input field; 

4) use the field signature as a key to query a field mapping database for a factoid for 
the represented context; 

5) receive a factoid from the file mapping database, the factoid containing contextual 
rules to more accurately recognize that natural input data; 

6) use the factoid as a key to query a user bias database for user bias data; 
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7) receive usinR bias data that can be used to further refine the recognition of the 
natural input data, within the represented context and in combination with the contextual rules, to 
more accurately recognize that natural data input; 

3) retrieving corresponding user specific biasing information for the input field from 

th e database that corresponds to the determined context; 

[4]8) communicate the natural input dat a, the factoid, and the use r specific biasing 
information data to the recognition engine so that the recognition engine can use the rules 
contained in the factoid and the user bias data to perform context-based recognition of the natural 
data input and receive a recognition result there from, the recognition result from analyzing the 
natural input data based on the user specific biasing information for th e input field ; and 

9) receive a recognition result from the recognition engine, the recognition result 
from analyzing the natural input data based on the rules in the factoid and the user-specific 
biasing information for the input field; and 

#10) provide to the executing program at least one computer code corresponding to the 
recognition result received from the recognition engine. 

16. (Previously Presented) The system of claim 15 wherein the field determination 
mechanism includes a field signature engine that generates a field signature corresponding to the 
context based on characteristics of the input field. 

17. (Previously Presented) The system of claim 16 wherein the characteristics of the 
input field include text displayed proximate the field. 

18. (Original) The system of claim 15 wherein the natural input data comprises 
speech or handwriting data. 

Claim 19. (Cancelled). 

20. (Currently Amended) The system of claim 19 wherein the field determination 
mechanism includes a field signature engine that generates a field signature corresponding to the 
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field type based on characteristics of the input field , and wherein each of the factoids in th e 
database are key e d by an index corresponding to the field signature . 

21. (Original) The system of claim 15 wherein the at least one database of biasing 
information comprises a database of sets of user bias data, and wherein the input system 
communicates the biasing information including a set of user bias data to the recognition engine. 

22. (Original) The system of claim 21, wherein the user bias data set communicated 
to the recognition engine is retrieved from the database of sets of user bias data based on the field 
type determined by the field determination mechanism. 

23. (Original) The system of claim 21 wherein the database is securely maintained on 
the computing device. 

24. (Original) The system of claim 21 further comprising a data harvesting engine 
that obtains at least some of the user bias data from at least one data store accessible to the 
computing device. 

25. (Original) The system of claim 24 wherein the database of sets of user bias data 
includes at least some data that was not harvested by the harvesting engine. 

26. (Original) The system of claim 24 wherein the data harvesting engine operates as 
a background process. 

27. (Original) The system of claim 15 wherein the at least one database of biasing 
information comprises a first database of factoids and a second database of sets of user bias data, 
and wherein the input system communicates the biasing information including a factoid and a set 
of user bias data to the recognition engine. 

28. (Original) The system of claim 27 wherein the factoid and the user bias data are 
retrieved from their respective databases based on the field type. 
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29. (Original) The system of claim 27 wherein the factoid includes information 
corresponding to at least one criterion with which the recognition result should comply. 
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30. (Currently Amended)) In a computing device, a system comprising: 

a field determination mechanism that determines a context of an input field from among 
a plurality of input fields in an executable program and provides a factoid field signature 
representative associated thereofwith; 

a field mapping database indexed by field signatures that contains contextual rules to 
more accurately recognize natural input data and provide a factoid of rules for a context 
represented by a field signature; 

a database of biasing information indexed by factoid that includesing sets of use r specific 
bias data used to further refine the recognition of natural input data, within a represented context 
and in combination with the contextual rules, to more accurately recognize natural input data and 
to provide user bias data for a represented contex t corresponding to factoids ; 

an input system configured to receive natural input data directed towards the input field, 
to obtain a factoid from the field mapping database determination mechanism , and to obtain 
user specific bias data corresponding to the factoid, wherein the natural input data comprises an 
input other than textual input, the use r specific bias data corresponding to the factoid for the 
input field differing from use r specific bias data corresponding to factoids for one or more other 
input fields of the executable program; 

a human input recognizer that converts natural input data to computer codes, the 
recognizer configured to receive the factoid, the use r - specific bias data and the natural input data 
from the input system, to analyze the natural input data based on the use r specific bias data and 
the rules contained in corresponding to the factoid, and to provide a recognition result 
comprising a set of at least one computer code to the input system based on the natural input 
data, the rules contained in the factoid and the use r specific bias data, the recognition result 
biased by the user- specific bias data; and 

the input system returning data to the executable program that corresponds to the 
recognition result. 

31. (Currently Amended) The system of claim 30 wherein the field determination 
mechanism comprises a field signature engine that generates a field signature for the field type 
and a field mapping database that provides the factoid based on the field signature . 
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32. (Original) The system of claim 30 wherein the factoid includes information 
corresponding to at least one criterion with which the recognition result should comply. 
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